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National K-12 Foreign Language Resource Center 
Evaluation Report 
February 1, 1994 - May 31, 1995 

The National K-12 Foreign Language Resource Center, one of six centers funded by the 
U.S. Department of Education, was established at Iowa State University to support K-12 
foreign language education nationally. Its purpose is to support training of elementary and 
secondary school foreign language teachers, particularly in light of the new national standards 
for elementary and secondary school foreign language. Irutiatives of the Center focus on 
professional development in three areas: the use of effective teaching strategies, development 
and interpretation of foreign language assessment, and the use of new technologies. 



The Evaluation Plan 

Evaluation of the National K-12 Foreign Language Resource Center is based on the 
goals and objectives of the Center and the intended impact of the activities on its target 
audiences. The focus of the evaluation is on assessing the degree to which the goals are 
accomplished. The goals and objectives, projects, and organizational structure have been 
designed to reflect the Center's overall purpose of contributing to the knowledge base, skills, 
and resources of foreign language teachers in grades kindergarten through twelve (K-12). The 
evaluation considers the resources, techniques, procedures, and strategies employed to 
accomplish the goals and objectives. Assessments of the effectiveness and efficiency of the 
Center provide information by which accurate judgments can be made about the strengths and 

weaknesses of operations and of program unpact. 

The evaluation provides (1) input ,■ 1 feedback from the teachers participating in the 
Center's activities and (2) an assessment of the status of Center activities. Needs assessments, 
formative evaluation, and summative evaluation are components of the conceptual and 
operational evaluation framework. The evaluation plan includes both quantitative and 
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qualitative methods to describe Center initiatives and measure participant attitudes and 
knowledge. Data sources include documents, records, survey instruments, products (e.g., 
manuals, publications, videotapes, logs of e-mail use), and observations. 

Formative evaluation throughout the first 16 months of Center operation has been of 
immediate use to those involved in administering the Center and carrying out its initiatives. 
Information collected through the internal evaluation of formative issues is to be included as a 
part of the summative evaluation activities to be completed for each funding period. 
Evaluation Plan Development 

The plan for evaluating activities of the National K-12 Foreign Language Resource 
Center was developed by staff at the Research Institute for Studies in Education (RISE) and 
was approved by the Center's steering committee on May 10, 1994 (Appendix A). The plan 
outlines a summary of the goals, outcomes, and benefits for each of the three initiatives 
proposed by the Center and the relationship of formative and summative measures to these 
goals, outcomes, and benefits. For each initiative, an action plan further describes each 
activity, a listing of appropriate evaluation measures, the parties responsible for conducting 
the evaluation activities, and an approximate timeline for conducting specific evaluation 
activities. Three groups, RISE, Center staff, and the Center for Applied Linguistics, agreed to 
provide evaluation data. The plan includes all activities for the proposed 30-month grant 
period. 

The plan for evaluating activities related to the summer Institutes is based on a 
planning cycle (Figure 1). The planning cycle details the order of evaluation events and their 
relationship to each other, as well as describing the responsibilities of the Center and 
evaluators with regard to evaluation activities. 



Results of the Evaluation of Center Activities - February 1, 1994 - May 31, 1995 
Center activities of the first period consisted of a series of summer institutes, a two-day 
workshop at the Center for Applied Linguistics in Washington, D.C., and several Center-based 
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Figure 1. Planning cycle for Evaluation of Institutes Conducted by the National K-12 Language Resource Center 



activities. RISE'S responsibility was to evaluate the institutes, the workshop and selected 
Center-based activities. RISE conducted and analyzed needs assessment data, collected and 
analyzed evaluation data from teacher and researcher participants, and analyzed Center- 
provided information, according to the evaluation plan. The fo'lowing sections describe the 
results for each of the evaluation activities, including descriptions of the methodologies and 
instrumentation when appropriate. A summary and discussion of the results follows. 
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Evaluation of Activities Related to Initiatives I and III 

The Center conducted a series of institutes during the summer of 1994. The institutes 
addressed two of the three initiatives, Initiative I: Training Teachers in the Use of Effective 
Teaching Strategies and Initiative III: Training Teachers in the Use of New Technologies. 

This section begins with a discussion of the instruments used to conduct the e\ aluation, 
followed by the results of the evaluations for each institute. Copies of the instruments are 
included in Appendix B. 

Instruments 

Three of the four institutes had an instructional focus and a common set of evaluation 
instruments: needs assessment, content understanding, and overall evaluation. The fourth 
institute. Curriculum, focused on critical analysis and strategy development rather than 
instruction. In that case, participants responded to open-ended questions about outcomes and 
strategies rather than the needs assessment and content understanding instruments. Curriculum 
Institute participants also completed an overall evaluation. 

N^gds Agggssment. Prior to each institute, participants were asked to complete a needs 
assessment that asked them to rate their level of previous experience with the topics that were 
to be covered in the Institute. The four categories provided to characterize their experience 
included: 1 = This will be basically new information, or a thorough review would be welcome; 2 
= I have some experience with the topic but do not feel entirely competent in the area; 3 = I 
have considerable experience with this topic and feel well informed; 4 = I could assist in the 
presentation of this topic by providing information and examples. The results of the needs 
assessment were used in modifying institute topics and activities. 

Content Understanding- To assess the impact of the institute on content knowledge, 
participants were asked to describe their understanding of the topic areas before and after the 
institute. The categories used to describe their perceived level of understanding included: 1 = 
no understanding; 2 = understand basic concepts and techniques; 3 = understand basic concepts and 
techniques and feel comfortable experimenting with their application; and 4 = am quite 
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comfortable with applying the concepts and techniques presented. When appropriate, 
participants indicated that a topic was not covered in the Institute on the "after" portion of the 
survey. 

F.valiiation . Participants were also asked to complete a short survey designed to 
evaluate the institute in general. A 5 point Likert-type scale (l=poor to 5=excellent) was used 
to evaluate approximately 10 aspects of the institute, such as clarity of the objectives, effective 
use of time, and effectiveness of the institute leaders. In addition, participants were given the 
opportunity to provide written comments regarding their impressions of the Institutes through 
three open-ended questions: Which aspects of the Institute did you find to be most useful and 
why? What suggestions do you have to improve the Institute? Other comments. 

Outcomes and Strategies . Participants in the Curriculum Iitstitute responded to two 
open-ended questions; What do you perceive as the major outcomes of the Institute? What 
steps should the Center take with regard to foreign language curriculum? 

Follow-up . At the end of the academic year, participants from each of the institutes 
were asked to complete a survey prepared by RISE staff. Respondents were asked to describe 
the amount of communication with Center staff, institute leaders, and other participants and 
express their opinions about Center and Institute leader support. Seveia! open-ended questions 
asked them to describe (1) how they have changed their teaching as a result of the past year's 
experiences with the National K-12 Foreign Language Resource Center and (2) formal and 
informal information sharing and presentations given since the Institute. The respondents could 
choose to answer the survey through e-mail, postal mail, or fax. Of the 58 respondents, 4 j /o 
answered via e-mail. 




5 



n 



Initiative I: Use of Effective Teaching Strategies 

Teacher Educator Partnership Institute 



Introduction 

The Teacher Educator Partnership Institute was designed to address the first of the 
Center s initi^ives: training teachers in the use of effective teaching strategies. The goal of 
the Institute was to provide a professional development opportunity in effective teaching 
strategies for K-12 foreign language teacher educators who serve as methods professors at 
ins^tutions of higher education. Special consideration was given to providing training and 
classroom experiences at the K-6 level because most teacher educators do not have direct 
experience at those levels. A unique feature of the Institute was the formation of partnerships 
between teacher educators and practicing teachers foi collaboration on a project during the 
coming year. 

Description of Participants 

Twenty-two participants attended the summer workshop of the Teacher Partnership 
Institute. All but one of the participants were female. Nine of the participants were teacher 
educators. Eleven of the 13 teacher practitioners were elementary school foreign language 
teachers. 

Teacher practitioners had an average of 7.7 years experience teaching grades K-6. Six 
taught Spanish, three taught Spanish and French, two taught Japanese, one taught French, and 
one taught Spanish and Latin. Six of the teacher educators taught post-secondar\^ Spanish, one 
taught Japanese, and tw<^ taught Spanish and Japanese. 

Needs Assessment 

Table 1 presents the results of the needs assessment for all participants, as well as 
disaggregated results for teacher educator and teacher participant. Participants as a whole 
felt that they had considerable experience and/or could assist facilitators in developing 
language skills in listening, speaking, reading, writing, and interactive writing. They had the 




6 



lO 





7 



lod i^ur 



Table 1 (con’t) 



S49uotit^^vdd uaipvaj. puv 
suo^vonpa 23tf0vaj. U39cn4aq 
9Duai3mp zuv^tftuEu; 



c 

o 



XJ 

ra 



QJ 

X 

XJ 

H 



sasuodsBu fo u 



ro m ro m ro 



aouv^stssv aptaoUfj 
BDUJUBclxB ajqvuaptsuoj 
D0ll3U.BdxB diuo^ 
uoiivtuuo/uj mafsl 



CM CO CS 



V) 

}-4 

o 

XJ 

3 

•o 

U 



XJ 

r9 

QJ 

H 



SBSuodsau /o u 



9Duv^sissv aptaoUfj 
3ouBu.BdxB ajqvuapisuoj 
3DU3U.3dxB BUlO§ 
uotivuuo/ut 



CM C O 



cs ro CO ro 



CO in fsi fsi 



SBSuodsau /o u 



CN 

CM 



CM CM CN CN t— <N O 

{N CM (N tN CM m CM 



CM 

CM 



<N 

CM 



c 

r9 

Cl, 



cu 



BDUVlStSSV BptaOUfJ 
BDUBuadxa ajqvdBptsuoj 
BDUBUadxB BUIO^ 
UO}lVULlo/ut aiB^ 



CM CO CM 



in vO 



ir! C 30 



tc 



t/i Jl: 



tc 

c 



tc 

c 

'a, 

o 







t/5 




— 




{/J 


Ijii 


15 


tc 


5/5 




c 


&c 


tc 


15 




C 


rj 






D 


rs 




CL. 


O 


> 


1/5 


k. 




CjC 


tc 


C5C 


c 


C 




Cu 




'5- 


o 


O 


o 


D 


D 


D 






> 


D 


D 


D 






CO 


— 







* 7 : c 

O 

^ - — 

* 5 ^ 
^ 2 

-I 

cz c 
C 

ID C 
D C 

•S 3 

<D ^ 
j: 'd 



c 

o 



a 

*tj 

D 

<z 

JH 

tc 

"C 

c 

(D 



£ x; 



1 £ 


. - 3 

c 1 


3 

”3 

U 


'■/5 3 


C/ 




y: 




D o 


II 

C 3 


u 

rz 


r. ^ 
D 

.£ > 
u. D 

** TT 



P 3 

c 



fcC 



"C 

c 



H :u -5 iC 3 




: 5 



Table 1 (con’l) 



U3UO}i}^OVldjiat{OV3i puv 

sxoivonpa jl3Ujv 3^ iiBBcn^aq 
3JU3U3U1P lUVOlIu^tS.. 


« 


« 


« 












* 


£2 


sasi/o^ai /o u 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


CO 


c 

o 


djuv^sissv aptaoifj 


rO 


(M 


CM 


- 


CM 


CM 


CM 


CM 


CM 


u 

m 

Cm 


aoududdxa ajqv^apisuoj 


vO 






\0 


\0 


in 


CM 


in 


CM 


s 

J3 


3JU3U3dX3 3XUOS 


tT 


rr 




rO 


in 


CM 


tT 




CM 


o; 

H 


UO}lVUUo/u} 0131^1 


o 


o 


o 


CO 


o 


tT 


m 


in 


CM 


!2 

o 


S3SUOdS3JL /o U 


o 


O' 


O' 


O' 


O' 


O' 




CJ' 


O' 


3JUVZSISSV 3piaOId 


o 


o 


o 


o 


CM 


o 


o 


o 


o 
























UJ 

w 


3JU3U3dX3 3iqVX3piSUOJ 


(N 


(M 


o 


-- 


tT 


o 




r-i 


o 


O 

J3 

« 

H 


3JU3U3dX3 3tUOS 


vO 


X? 






CO 






CM 


vO 




UOl^VULlo/ut 013 ls[ 






CM 




o 


CM 


CM 


vO 


CO 




S3SUOds3J /o u 


(N 

CM 


CM 

CM 


CM 

CM 


CM 

CM 


CM 

CM 


CM 

CM 


o 

CM 


CM 

CM 


CM 

CM 


(A 

«t^ 

c 

fO 


3 juv;stssv spiaoif^ 




CM 


CM 


- 




CM 


CM 


CM 


CM 


a 






















*C 

Im 


3JU3U3dX3 3jqVI3p}SUOj 


00 


O' 






O 


in 


CO 


vO 




fC 

cu 

< 


3JU3U3dX3 3UIOS 




- 






00 


o 


00 


CO 


OC 




uot^vtuuo/ui 013 


f -- 


- 


CM 




o 


vO 






in 



3 



rz 

tc 

C 

P3 

3 



u 

< 






.iri 

£ 

'o 

Z) 



c 

fC 

■5 



CX 

c 



o 

CL 

3 

£ 

tc 



1 

rs 



C- 



.E 

£ 

s 



s 

.2 

rz 

t 

-O 

3 

CL 



U 

Ic 

3 

CL 



r 

C- 



rz 

CL 

■g 

c 

iS 



I i. 

So s5 
£ 

Is 
|i 

” o 

|l 

2>i 



I I 1 I 

ii li 

t I 1 1 

|j!!l 



i» 

-8 



1 



1 I ^ 



£ 

i 

u. 

o 

5 



|i! t 

ON 

1 1 & i 

ill 

f I K 

1 N I 

2 I 3 s 



I 

lil 



I III 

3 t i 4 

4ijl 






L J 



ERIC 



9 



least experience with theories of child development and uses of technology for teachers and 
students. 

Teacher practitioners and teacher educators differed on the level of experience reported 
for the topics that were to be covered in the Institute. In general, teacher practitioners reported 
greater experience in all of the topic areas. These differences were statistically significant 
(p<.05) in the following areas: program planning; integrating foreign language with the 
elementary school curriculum/subject content instruction; activities and games; use of music and 
songs; rhymes and chants; and working with administrators, classroom teachers, and other 
subject specialists. 

All participants were asked to indicate those areas or topics they felt should receive 
special emphasis during the Institute. There was considerable variation in the responses and 
the items marked to receive special emphasis were not necessarily the areas of least 
experience. The topic selected most frequently (by 7 of 21 participants) was integrating the 
foreign language with elementary school curriculum/subject content instruction. The topic 
marked most frequently by teacher practitioners was articulation. Over half of the nine 
teacher educators selected integration (6 participants) and specific strategies for the classroom 
(5 participants). Teaching culture and global education, and principles and processes for 
curriculum development were each selected by three participants. 

Content Understanding 

In general, participants believed that they had a better understanding of all of the 
topics following the Institute (Table 2). For all topics, participant ratings of understanding 
after the Institute were significantly higher (p<.05) than their ratings before the Institute. 

There were some differences between the teacher educators (Table 3) and teacher 
practitioners (Table 4) on self-reported understanding before the Institute. Again, the ratings 
for teacher practitioners tended to be higher than those of teacher educators. These differences 
were statistically significant (p<.05) for the following topics: history and rationale for 
elementary and school foreign language programs; program models; program planning; child 
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Use of music and son^s 



Table 3 (con’t) 
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CtMvsidorjblv F^j>trioncc “ I have con\*Hrr able ex^xTionu* vMfh this topic and fi*ol well inlnrnu'd 
Pro\ ide As.M>laiuo << I could a^bist in prcst'otation of Ihib topic by piov iding informatimi and examples 
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I hild dcvelopmonl ihoories (i.c., Piaget, Kioran 
Egan, information-processing perspectives) 

Developing listening skills 



Table 4 (con't) 
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• Teacher educators ratings significantly lower than teacher practitioners (p<.05). 

New Informitum - This will be basically new ii\formalu>n. or a Ihorough review would be welcome 
Some txjxTieme = 1 have some ex^^nence with the ti>pic but do not feel entirely com^>etenl 
auxsiderable txjx-nence • I have considerable ex^vrience with this topic and feel well informed 
Pros idp Assistance = I amid assist in piesc-nlation of this topic by providing information and examples. 



development theories; integrating foreign language with elementary school curriculum /subject 
content instruction; activities and games; use of music and songs; rhymes and chants; working 
with parents and parent groups; and working with administrators, classroom teachers, and 
other subject specialists. 

After the Institute, differences between teacher practitioners and teacher educators 
remained on the following three topics: history and rationale; program plarming; and working 
with administrators, classroom teachers, and other subject specialists. There was an 
additional post-institute difference between teacher practitioners and teacher educators in the 
area of second language acquisition. Again, the ratings for teacher practitioners were higher 
than those of the teacher educators. 

Institute Evaluation 

Evaluation ratings indicate that the participants were generally pleased with the 
Institute (Table 5). Averages ranged from 3.41 (electronic mail training) to 4.86 (applicability 
of information) on a 5-point scale. 

Participant comments provide additional information about the most useful aspects of 
the Institute. Over half of the respondents indicated that providing opportunities to interact 
with Institute leaders and other participants was very beneficial. Many also mentioned 
gaining a better perspective of current practice in foreign language education as well as new 
ideas for their own classrooms. Several commented specifically on the value of leaders 
modeling teaching methods discussed during the Institute. 

Suggestions for improving the Institute often included allowmg more time for 
interaction among participants. Several commented on the intensity of the Institute, but could 
not identify topics or activities that were of little value that could be eliminated. A few 
suggested improving the e-mail training, perhaps by pairing more experienced participants 
with those less experienced. Overall, many of the general comments expressed feelings similar 
to one participant who said, "I found this to be a very valuable experience ... I will change the 
way I do some things.*’ 
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Table 5. 1994 Teacher Educator Partnership Evaluation - Frequency of Responses 
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Follow-up 



Twenty-two participants were surveyed at the end of the 1994-95 academic year to 
obtain follow-up information about their institute-related activihes during the school year. 
Sixteen responded (73% return rate). 

The majority of the respondents from the Teacher Educator Partnership Institute agreed 
that the amount of their communication with Center staff. Institute leaders, and other 
participants was about right (Table 6). 



Table 6. Amount of Commimication by Participants of the 1994 Teacher Educator Partnership 
Institute - Frequency of Responses 





Too little 
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Too much 


with Center staff 
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15 
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15 
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with other participants 
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0 



Almost all of tire respondents agreed that communication with Center staff. Institute 
leaders, and other parhcipants was useful. In addition, the majority agreed that the Center 
has been a valuable source of materials and information and has been supportive of projects and 
that Inshtute leaders ha\-e been supportive of teaching efforts and projects. All respondents 
agreed that the skills and information gained from the Inshtute have been useful, and all but 
four agreed that their project has been useful. See Table 7 for detailed frequency information. 

Participants of the Teacher Educator Partnership Institute attributed several changes 
to their participation in the Institute. While some teachers indicated that they had not had 
time to implement any ideas, most of the participants commented that they had incorporated 
several of the strategies they had seen modeled at the Institute into their own classrooms. 
Some specific examples included the use of "language signing" and using "thematic units." 
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Table 7. Follow-up Perceptions of Participants for the 1994 Teacher Educator Partnership InsKl Ue - Frequency of Respoj 



SBSUOdS 9 U /o u 



dBuSv Rl^UOI^S UO 2 dJ&V u 



VOVOVO VO Z ^ ^ 

»— t— t— ^ 



rr tn OS 



o sO 



(/> 



3DuSv djSuOSiS ’ 9 



33d^Y - g 



33jSv ;vi{m.3iuos - 



\0 00 



00 



in 



in in iJl rs‘ 



sO 00 O' CM rr 



(N CN 



o rJ vO 



DBuSvsip im[cti3mos - £ 



o o o 



o 



<N C 




33uSvSlQ - Z 



o fsi r4 



c 



<N 



30dSv$tp /tjSuOSJS ' I 



Zj 

u 



•£ 

> 

c 





My institute project has been useful to me professionally. 



A number of these teachers commented that they now felt more comfortable with 
computers and technology, especially with e-mail. Several indicated that they were now 
"looking for opportunities to incorporate the technology." 

Overall the respondents felt that one of the biggest gains was networking with other 
teachers. The Institute created opportunities to make contacts that they had maintained after 
it ended. As one participant put it, "I have been able to network with teachers around the 
nation. I am now able to discuss my work and ideas with others in similar situations." 

Ten respondents indicated that they had given a total of 36 presentations, 
demonstrations, or workshops related to the institute; the presentations vyere attended by 
approximately 775 other high school teachers, university professors, student teachers, and 
other colleagues at state and national conferences. The presentations covered a wide range of 
topics, including e-mail, articulation and proficiency, strategies for teaching reading and 
vocabulary, storytelling, and music. 

In addition to formal presentations, most indicated that they had shared information 
about the Institute informally. As one participant commented, "I talk about it all the time." 
Participants indicated that most sharing was done through "word of mouth;" a few also 
communicated through e-mail and newsletters. 

Additional comments about the Institute indicated that the support from Institute staff 
and the opportunity to network were the most appreciated aspects. They recommended that 
funding for the Institute be continued and expressed the desire to involve more people. 

Initiative I: Use of Effective Teaching Strategies 

Curriculum Institute 

Introduction 

The purpose of the Curriculum Institute was to engage experienced practicing foreign 
language educators in the critical analysis of traditional curricula for foreign languages and to 
develop new strategies and frameworks for the emerging long sequences of language study. 
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Description of Participants 

There were 24 participants in the Institute. All were from K-12 institutions; all but two 
were from public schools. Over half of the participants reported holding district level 
positions such as director or chair of the foreign language department. At the same time, 17 of 
the 24 respondents listed "teacher" as their position title. Six of the participants indicated 
that they were elementary teachers. 

Participants reported K-12 teaching experience ranging from 3 to 42 years, with an 
average of 17.8 years. One third of the respondents (8) taught more than one language, eight 
listed Spanish as their major second language, and seven reported teaching French. 

Participants also reported teaching Chinese and Russian. 

Outcomes and Strategies 

Three themes emerged from responses to the question: What do you perceive as the 
major outcomes of the Institute? By far the most frequent recommendation made was for the 
Center to disseminate the information put together at the Institute (15 of 23 participants). 

Many suggested strategies for dissemination of information, such as publishing the materials 
and having the participants distribute the information in the states in their areas. The second 
most frequently mentioned outcome was the specific products that were started and/or 
completed during the Institute, especially the Guiding Assumptions document. 'Phe third theme 
reflected appreciation for the training and experience and a commitment to share their 
experiences with others. 

Institute Evaluation 

All but one of the participants completed the eight item evaluation form (Table 8). 
Average responses ranged from 4.00 (clarity of Institute objectives) to 5.00 (effectiveness of the 
Institute leader(s)). 

Two themes were prominent in the comments about what participants liked best about 
the Institute. The first was the opportunity to interact with a diverse group of educators. As 
one participant stated: "The opportunity to interact with educators from across the country. It 
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Table 8. 1994 Curriculum Institute Evaluation - Frequency of Responses 
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has been exciting and motivating. We need more opportunities like this one to share, to learn, 
to network." The other theme focused on the quality of the Institute's facilitators. Various 
strengths cited included their knowledge, skill, organization, and flexibility. 

To improve the Institute, some participants suggested less time be spent on introductions 
and team-building activities to maximize time devoted to the projects. Others wanted more 
time to interact with other participants. Still others suggested ways to lengthen the Institute, 
including making provisions for tiiis group of participants to return next summer. The only other 
dominant theme was the recommendation that the information distributed to participants be 
more specific, particularly with regard to the e-mail project. 

Follow-up 

Twenty-four participants were sent surveys at the end of the 1994-95 academic year to 
obtain follow-up information about their institute-related activities during the school year. 
Fourteen responded (58% return rate). 

The majority of the respondents from the Curriculum Institute agreed that the amount 
of their communication with Center staff. Institute leaders, and other participants was about 
right (Table 9). As shown in Table 10, the majority of respondents agreed that communication 
with Center staff. Institute leaders, and other participants was useful. Half or more agreed 
that the Center has been a valuable source of materials and information and has been 
supportive of projects and that Institute leaders have been supportive of teaching efforts and 

Table 9. Amount of Commimication by Participants of the 1994 Curriculum Institute - Frequency 



of Responses 



Too little About right Too much 



with Center staff 
with Institute leaders 
with other participants 



2 

3 

4 



12 

11 

10 



0 

0 

0 



Table 10. Follow-up Perceptions of Participants for the 1994 Curriculum Institute - Frequency of Responses 




aau^v fijSuou^s lo aauSv u 



r . <N fM 



OO 




o 



28 



ERIC 






projects. Most respondents agreed that the skills and information gained from the Institute 
have been useful and that their project has been useful to them professionally. 

The following comment from one of the Curriculum Institute participants is illustrative 
of the feedback gathered regarding the impact of this institute, "This institute provided food 
for thought, expertise, and resources which fueled our work." 

A number of participants indicated that they were incorporating the computer as a 
teaching tool, using it to help students learn new vocabulary and grammatical concepts. 

Several commented that resources they picked up at the Institute had fit in with activities 
they were trying in their classrooms. Many also indicated that they were using the Internet to 
share ideas and get information. 

Eight of the respondents noted that they had made a total of 32 presentations to 855 
other teachers, administrators, and parents at workshops at their schools and at conferences. 
Presentation topics included curriculum development, curriculum rationale and implementation, 
and classroom activities. Respondents enthusiastically shared information about their 
institute-related experiences through informal discussions, other conferences, open meetings, 
and newsletters. 

Additional comments from these participants indicated that they felt the Institute 
had been very valuable and that the greatest benefit was the opporturuty to network. As one 
participant wrote, "the collegiality that was established was powerful." 

Initiative III: Use of New Technologies 

New Technologies Institute 

Introduction 

The New Technologies Institute was designed to introduce participants to the benefits 
of using newly developed technologies in foreign language education. Participants examined 
recent developments in the application of new technologies to the learning of foreign languages, 
previewed exemplary foreign language courseware, including multunedia programs, 
implemented use of telecommunications networks to enhance students reading, writing, and 



cross-cultural communications skills; developed telenetworking lessons for use with existing 
curricula; gained expertise in the use of electronic mail, forums, and bulletin boards; and 
continued dialogue with Institute personnel and participants during the academic year via 
telecommunications. 

Description of Participants 

A total of 20 participants attended the New Technologies Institute. Nineteen of the 
participants were from public schools; one was from a private school. Four were elementary 
teachers (K-8), 14 taught at the secondary level, and two participants did not indicate their 
grade level. Eleven of the participants taught French and 10 taught Spanish. German, 
Japanese, and Romanian were among the languages taught by participants. Five of the 
participants reported teaching more than one language. Participants had from 2 to 31 years of 
K-12 teaching experience, averaging 17.9 years. 

Needs Assessment 

Responses to the needs assessment are summarized in Table 11. Overall, very few of the 
participants indicated that they had considerable experience or felt they could assist in the 
presentation of any of the topics to be covered in the Institute. 

Fourteen of the 20 participants indicated the topics they thought should receive 
special emphasis during the Institute. At least half of the 14 respondents felt that the topic 
areas of setting up sister schools networking and educational uses of e-mail should receive 
special emphasis. 

Responses to the open-ended questions suggested that there was a wider rainge of 
experiences with technology among participants than was evident in the responses to the 
content portion of the survey. These responses indicated that a few of the participants had 
little or no experience with technology, while some had experience with quite sophisticated 
technologies. The discrepancy between the content and the open ended responses might mean 
that participants underestimated their own capabilities and/or had high expectations for the 
Institute. 
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Table 11. Needs Assessment for the 1994 Ne w Technologies Inslitute - Frequency^fResponses 
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Table 11 (con’t) 
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Table 11 (con't) 
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Participants’ goals for the Institute were of three very general types. The first included 
information and experience with specific hardware, software, or telecommunication systems. 
This goal also reflected a range of sophistication regarding the use of technology. For example, 
some wanted information about software programs to use in their classrooms, while others 
wanted information to facilitate distance communication and multimedia platforms. Second, 
they wished to address specific problems, including promoting the importance and use of 
technology, and telecommunication among their colleagues and administration and overcoming 
resource limitations. Finally, they indicated introducing or expanding the use of technology in 
the classroom as a broader goal. 

Content Understanding 

Participants showed significant improvements in all topics covered by the New 
Technologies Institute (Table 12). 

Institute Evaluation 

Participant ratings indicated general satisfaction with all parts of the Institute (Table 
13). Each aspect was rated above average or excellent by at least three fourths of the 
respondents. The highest rated aspect was effectiveness of the Institute leaders, which was 
rated "excellent” by all but one participant. Nineteen of the 20 participants also assigned an 
overall rating of excellent to the Institute. 

Several common themes were apparent in the participants' comments about the most 
useful aspects of the Institute. Learning to effectively use e-mail and the Internet was 
mentioned by over half tlie respondents. Participants also appreciated the hands-on format of 
instruction, the opportunity to meet and exchange ideas with other teachers, the textbook, and 
the exposure to different software. 

Participants responded with a variety of ideas for improving the Institute, including 
making the Institute longer. Participants wanted more time to explore programs and software 
and to practice using their new skills. Other suggestions included adhering to announced dates 
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Table 12 (con't) 
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Table 12 (con’l) 
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Table 13, 1994 New Technologies Institute Evaluation - Frequency of Responses 
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and times, specifying in advance the Macintosh-only environment and a required follow-up 
project, and adding follow-up sessions. 

Follow-up 

The twenty participants were sent surveys at the end of the 1994-95 academic year to 
obtain follow-up information about their institute-related activities during the school year. 
Seventeen responded (85% return rate). 

All but one of the respondents from the New Technologies Institute agreed that the 
amount of their communication with Center staff and Institute leaders was about right, while 
six ci the 20 respondents felt that there was too little communication with other participants 
(Table 14). As shown in Table 15, over three-fourths of the respondents agreed that 
communication with Center staff. Institute leaders, and other participants was useful. Half or 
more than half agreed that the Center has been a valuable source of materials and information 
and has been supportive of projects. Most agreed that Institute leaders have been supportive of 
teaching efforts and projects and that their project has been useful to them professionally. 

Table 14. Amount of Communication by Participants of the 1994 New Technologies Institute - 
Frequency of Responses 

Too little About right Too much 

with Center staff 1 16 0 

with Institute leaders 1 16 0 

with other participants 6 11 0 



Almost all felt that the skills and information gained from the Institute have been useful to 
them professionally. 

Changes in practice indicated by the participants of the New Technologies Institute 
included greater use of e-mail, greater awareness of the possibilities for incorporating 
technology in the classroom, and increased networking. 
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Table 15. Follow-up Perceptions of Participants for the 1994 New Technologies Institute - Frequency of Responses 
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While some were just starting to use e-mail in their classes, many indicated that they 
were trying a variety of applications. One respondent commented, "We have used computers to 
write diary entries, [have] done peer editing, [have] participated in [producing a] cooperative 
newsletter among four schools, and [have] used Internet resources for research projects." Others, 
however, were not so fortunate. They did not have the hardware and software nor access to 
Internet in their schools. "E-mail is not accessible, but I talk with staff and students about the 
Internet. There haven't been any changes yet. I need fimds to purchase hardware and 
software." 

Eleven respondents indicated that they had made a total of 30 formal presentations to 
790 attendees. These included presentations to local, state, regional, and national foreign 
language associations, inservice workshops, and presentations to students. Presentation topics 
included the use of the Internet, foreign language applications, and writing. Participants also 
indicated that they were actively sharing Institute information, such as sharing HyperStudio 
stacks with other instructors, writing articles for newsletters, and sharing information at 
conferences and workshops on an informal basis. 

Additional comments from participants reiterated the role of the Institute in promoting 
the use of technology in schools and in developing teacher skills and confidence in using 
technology. As a result of the Institute, many of these teachers have assumed leadership roles 
in their districts and/or states. The following comments illustrate these points. "The Institute 
gave me the push needed to . . . become an avid computer user and advocate of use of technology 
in the classroom." ". . • thanks to the New Technologies Institute and the NFLRC ... I am so far 
one of the few teachers [in my district] with really practical training and some level of skill on 
the Internet." "[As a result of the Institute] my principal and the district technology- 
coordinator view me as a major contributor to integrating technology into [school name] 
curriculum. They respect my work, use it as models for other curriculum areas, and solicit advice 
and ideas from me. I am co-chair of the Standards Framework Writing Committee for foreign 
language in [state name]. This responsibility resulted from my project" 



Initiative III: Use of New Technologies 

Interactive Multimedia Authoring Institute 



Introduction 

The Interactive Multimedia Authoring Institute was designed to introduce participants 
to the benefits of using multimedia, including CD ROM and videodisk, in foreign language 
education. Participants examined exemplary multimedia hardware and software; authored a 
HyperStudio (rather than HyperCard, as originally proposed) stack and produced lessons that 
effectively met objectives of the foreign language curriculum; prepared a HyperStudio lesson 
linked to segments on a CD ROM and/or videodisk or a segment of motion video; incorporated 
multimedia into foreign language instruction; and continued dialogue witli Institute personnel 
and participants during the academic year via telecommunications. 

Description of Participants 

Of the 20 participants, 18 were from public schools and two were from private schools. 
Eight reported teaching in elementary grades (K-8) and 11 at the secondary level. Seven of the 
participants were Spanish teachers and four taught French. German, Japanese, Russian, and 
Chinese were among the languages taught by participants. Three of the participants reported 
teaching more than one language. The average K-12 teaching experience reported by 
participants was 11.4 years, with a range of 3 to 23 years. 

Needs Assessment 

Responses to the needs assessment are presented in Table 16. Most of the participants 
indicated that they had some experience in the topic areas or that the content of the Institute 
would provide them v/ith new information. Because only five of the participants marked the 
topics they thought should receive special emphasis during tiie Institute, these data provided 
little insight. 

Open-ended responses suggested that there may have been a wider range of experiences 
with technology among participants than was evident from responses to other parts of the 
survey. Participants indicated that their experiences ranged from basic word processing to 
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Table 16. Needs Assessment for the 1994 Multimedia AuthorinR Institute - Frequency of Responses 
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I'nnuie A«-s, stance ^ 1 iiuilil asMSt in presentation of this topic b) prouding information and examples 



presentations and distance education. Again, the discrepancy between the checklist and the 
open ended responses might mean that participants had underestimated their own capabilities 
and/or had high expectations for the Institute. 

There were a number of common themes among participants' goals for the Institute. One 
theme was networking with students in other districts and countries through e-mail and other 
means of communication. Another theme was incorporating a number of technologies into 
lessons; a third was integrating technology into the classroom. Specific goals in this area dealt 
with classroom management, managing limited resources, facilitating students' use of 
technology to develop their own presentations, and using technology for assessing student 
progress. Finally, there was considerable interest in promoting the use of technology in their 
schools. This theme was evident in the desire to learn about software and hardware cind to be 
able to demonstrate its use, and to learn how to evaluate software and hardware to facilitate 
purchasing decisions. 

Content Understanding 

Participants showed significant improvements in all topics related to foreign language 
multimedia programs, their computer-based hardware experience, and background in 
multimedia (Table 17). However, participants reported gains in only two out of the five topics 
related to general computer software and foreign language specific software. This may indicate 
that a majority of the topics in these areas were not covered or that they were not covered in 
enough depth to increase understanding. Participants' understanding of word processing, 
database and spreadsheet programs, drill and practice, and tutorials did not increase 
significantly. Over half of the participants commented about the lack of instruction on 
DOS/Windows (IBM compatibles). 

Institute Evaluation 

All aspects of the Institute were rated above average or excellent by at least three 
quarters of the respondents (Table 18). The highest rated aspects were effectiveness of the 
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software: simulations 



Table 17 (con‘l) 
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Pre-Institute Post-Institute 
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Institute leaders (5.00), overall rating of the Institute (4.83), usefulness of the curriculum 
resources provided (4.79), and applicability of infoi-mation (4.75). 

Topics frequently mentioned as most valuable included e-mail training, learning to use 
authoring software (particularly HyperStudio), and the emphasis on hands-on activities. 
Participants appreciated the helpfulness of Institute staff and the opportunity to meet and 
exchange ideas with other foreign language teachers. 

Participants' suggestions for improving the Institute included allowing more time to 
work on projects, to share ideas with other teachers, and to preview commercial software. 
Follow-up 

Twenty participants were sent surveys at the end of the 1994-95 academic year to obtain 
follow-up information about their institute-related activities during the school year. Eleven 
responded (55% return rate). 

Most of the respondents from the Interactive Multimedia Authoring Institute agreed 
that the amount of their communication with Center staff. Institute leaders, and other 
participants was about right (Table 19). As shown in Table 20, approximately half of the 
respondents agreed that communicaticm with Center staff. Institute leaders, and other 
participants was useful. Only two agreed that the Center has been a valuable source of 
materials and information, while seven of the respondents somewhat agreed. Five agreed that 
Institute leaders have been supportive of teaching efforts, but fewer reported that the Center 
and Institute leaders were supportive of their projects. All agreed that the skills and 



Table 19. Amount of Communication by Participants of the 1994 Interactive Multimedia 
Authoring Institute - Frequency of Responses 
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information gained from the Institute have been useful and most agreed that their project has 
been useful to them professionally. 

Participant comments reflected a variety of changes in their teaching as a result of 
participation in the Institute. Some noted that they had incorporated HyperStudio 
applications into their classroom activities and many mentioned using e-mail. In the words of 
one participant, I have had my students develop HyperStudio stacks in our new six-station 
multimedia lab. We have recently had an e-mail exchange with a French class in Russia 
(facilitated by [name], one of last summer's participants) and are now exchanging messages 
with a class in Oregon." Another explained, "I pushed to have our computer lab installed ... 1 
solicited funds from various organizations to support our technology needs. I have been using 
the lab facility approximately ten times more than I have in the past with more confidence in 

my abilities and the abilities of my students." 

However, several indicated that they were not able to apply in their classrooms what 
they had learned at the Institute due to a lack of resources at the building level. As one said, 
"[My teaching] did not change directly . . . because our school does not have computer access for 
our foreign language students." This participant did report using e-mail to obtain information 
for classroom use. 

Six teachers indicated that they had given a total of 13 presentations to 
approximately 400 attendees. Presentation topics included use of HyperStudio, discovering the 
Internet, and technology for foreign language classrooms. Participants also shared information 
gained at the Institute with parents, building administrators, and other colleagues through 
informal discussions and newsletters. 

Additional comments indicated that, in general, participants felt that the Institute 
was valuable and that the Institute staff was supportive. A few indicated, howevei, that the 
project was too time consuming and that one semester was not long enough to implement the 
project. Comments also suggested that opportunities to "put ideas into practice" fell short due 
to a lack of resources at the building level. 
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Evaluation of Activities Related to Initiative II 



During Fall 1994, a two-day workshop addressed Initiative II: Administration and 
Interpretation of Foreign Language Performance Assessment. This section begins with a 
description of the workshop and its goals, followed by the results of the evaluation. 

Initiative 11: Administration and Interpretation of Foreign Language Performance Assessment 

Assessment Guidelines and Strategies Workshop 

Introduction 

The Assessment Guidelines and Strategies Workshop was designed to find out from 
classroom foreign language teachers how they currently use assessment, how they view 
assessment, and what can be expected of teachers in the classroom related to assessment. This 
workshop, co-sponsored by the Center for Applied Linguistics (CAL), was the first step in 
teachers working in collaboration with researchers to develop guidelines, or a framework, for 
assessing the language of students in their own classrooms. The guidelines will be based on the 
American Council on the Teaching of Foreign Language's (ACTFL) national K-12 standards for 
foreign language education and will target grades four and eight. The outcome of the workshop 
will be a better understanding by both teachers and researchers of actual practices and various 
assessment techniques and the national standards. 

Description of Participants 

Participants included 12 teachers and eight researchers/collaborators with expertise in 
assessment. Five of the teachers taught Spanish, four taught French, one taught French and 
was a resource teacher, one taught Japanese, and one had taught Chinese and was a resource 
teacher; eight of the teachers reported teaching at the elementary level, and the two resource 
teachers work at both the elementary and middle school levels. Teachers were selected upon 
recommendation by their principal or foreign language coordinator for their demonstrated 
competence in the classroom and their interest in foreign language assessment. 
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Workshop Evaluation 

Fourteen of the 20 participants completed the evaluation form developed by CAL and 
Center personnel and distributed at the end of the workshop (Table 21). In general, respondents 
were pleased with the workshop. Hotel accommodations, variety of participants, agenda, and 
applicability of the information were rated good or excellent by all respondents. Two 
respondents who rated information provided in advance as fair indicated that they would 
have liked to have had the agenda in advance. 

There was clearly a consensus among respondents regarding the most useful aspect of the 
workshop: meeting other teachers and learning what they are doing in their programs. 
Respondents frequently mentioned sharing, discussion, interaction, and networking. 

Portfolios and rubrics were mentioned most frequently as assessment strategies that 
respondents learned about and thought could be used in their classrooms. Journals, report card 
formats, and self-assessments were also mentioned. Even those who were aware of some of 
these strategies suggested that they learned more about them and had new ideas for using them 
in their classrooms. 

Most of the participants made suggestions for specific topics to be covered at next year s 
meeting. Topics included pilot programs, interpreting assessment results, specific training (e.g., 
computers, instrument testing), new instruments, and ACTFL guidelines. Recommendations for 
format changes included increased time for discussion, grade level and/or program-specific 

focus groups, and more small group interaction. 

Closing conunents by respondents expressed appreciation for the opportunity to 
participate in the workshop. Interacting with and learning from participants with similar 
interests and needs seemed to be extremely valuable. One respondent expressed the sentiment of 
many, saying, "Thank you for this opportunity. I am learning so much that will be 
immediately applicable at home. It was so nice to be treated like a valuable, intelligent 
individual. This was wonderful!" 
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Table 21. 1994 CAL Workshop Evaluation 
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Follow-up 



In the winter of 1995, the Center published an assessment newsletter highlighting the 
activities of the participants of the workshop and the progress they made. Summaries of 
workshop presentations by teachers and students were also featured. E-mail addresses were 
included to facilitate communication and future collaborations. Summaries of two research 
projects and suggestions for designing assessments completed this first newsletter. 



Initiative II: Administration and Interpretation of Foreign Language Performance Assessment 

Annotated Assessment Bibliography Preparation 



Center staff have prepared an annotated bibliography of assessment instruments. 
Published and made available through the ERIC system, the bibliography contains 
standardized instruments and authentic tools such as oral assessment inventories, language 
portfolios, and student-teacher conferencing forms. In addition to each instrument, information 
on the target audience, appropriateness of the test, age level/ grade level and a point of contact 
w'ere included. Selected bibliographies of recent articles, books and documents on assessment, 
and commercially available tests were provided. All tests were cross-referenced by skill area 
and purpose. 



Evaluation of Center-Based Activities 

As agreed to in the evaluation plan. Center staff provided additional evaluative 
information to the internal evaluators about products completed by institute and workshop 
participants; electronic communication among the participants, leaders, and Center staff; and 
institute participant computer anxiety. This information is presented below. 

Summer institute participants were encouraged to implement ideas and strategies in 
their classrooms by working together on follow-up projects. They formed small collaborahve 
groups of three to five individuals and identified and designed a research project based on a 
topic addressed at the institute. The projects gave participants a practical opportunity to 



implement what they had learned. Project topics covered a wide range of themes and 
applications. Participants in the Teacher Educator Partnership Institute conducted several 
studies examining teacher certification in states with mandates for elementary school foreign 
language programs, perceived obstacles to implementing the National Foreign Language 
Standards, national standards in Rhode Island, Japanese immersion programs, and articulation 
in foreign language programs. Other projects included preparation of thematic units. 

Curriculum Institute participants developed a prototype for curriculum information networking 
in low population states; identified existing second language curriculum guides; identified 
classroom-tested, learner-centered activities; studied obstacles to implementing standards; 
identified state, regional, and national resources for curriculum specialists; and identified 
factors that make for successful transition from middle school to high school. Projects 
completed by the participants in the New Technologies Institute included compilation of a list 
of Internet applications in the foreign language classroom, creation of a literary magazine and 
various classroom applications using HyperStudio, publication of a Spanish newsletter, and 
development of a technology usage survey. Participants in the Interactive Multimedia 
Authoring Institute examined effective ways of using the Internet in the classroom, developed 
HyperStudio stacks, studied teachers use of technology in the classroom, made videos, and 
used distance learning classrooms. 

According to Center staff, these projects were challenging for the participants to 
complete because of: (1) limited precedence in the field for a similar model of institute-related 
projects, (2) a limited amount of time due to the busy schedules of K-12 teachers during the 
academic year and that the final reports were due by the following January, (3) a request by the 
Center that communication among small group members about the project be carried out by e- 
mail whenever possible, and (4) lack of experience among classroom teachers in carrying out 
projects of this type. Despite these challenges, 80% of the small group projects were completed 
and offer the profession information on a variety of topics. 
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The Center is making the results of the research projects available to the profession- by 
publishing summaries in the nationally distributed Center newsletter, submitting complete 
project reports for publication on ERIC, submitting three reports for review by professional 
journals, and proceeding with plans to develop a World Wide Web page on the Internet. 

A key component of each project was the use of e-mail for communication between 
institute staff and teachers. All of the participants attending each of the four summer 
institutes learned how to exchange e-mail using the Iowa State University Vincent gateway to 
the Internet. Their previous computer experience ranged from "none" to "quite a bit of 
experience," with only one participant having extensive experience. Participants were 
encouraged to continue e-mail communication with each other and with institute leaders during 
their post-institute collaborative projects. 

To assist institute staff in the e-mail training and follow-up throughout the academic 
vear, a survey to measure computer anxiety was completed by institute participants both prior 
to and after each institute. Overall, institute participants had relatively low computer 
anxiety. Elementary teachers who participated in the Teacher Educator Partnership tended to 
have a higher level of anxiety about using computers, although their scores were not 
statistically different than those of other participants. A comparison of pre-institute and post- 
institute scores indicated that participant computer anxiety was reduced significantly. 

Table 22 summarizes data about e-mail access and usage following the summer 
institutes. As indicated, there was a substantial increase in the number of e-mail accounts 
activated as of February 1995,- when compared to the number at the time of the Institute, 
particularly foi participants of the Teacher Educator Partnership and Curriculum Institutes. 

The table also provides a record of the number of messages sent following the Institutes. The 
number of messages (while providing only limited information since no comparison data are 
available and not all participants forwarded all of their messages to Center staff for 
tabulation) suggests active e-mail correspondence. Overall, the growth in the number of e-mail 
accounts and the volume of e-mail communication suggest an increased usage of e-mail following 
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Table 22. Summary of E-mail Use by 1994 NFLRC Participants 



Institute 


Number of 
participants 


E-mail address 
before institute 


E-mail address 
currently* 


Total messages 
exchanged 


Teacher 

Educator 

Partnership 


22 


23% 


86% 


216 


Curriculum 


24 


17% 


91% 


154 


New 

Technologies 


20 


40% 


100%, 


293 


Interactive 

Multimedia 

Authoring 


20 


50% 


85% 


96 


Totals 


86 


31% 


89% 


759 


* .\s of 2 / 0/95 



the institutes. This conclusio.^ is consistent with follow-up data collected by RISE at the end of 
the 1994-1995 academic year. 



Summary and Discussion 

The first 16 months of activities at the National K-12 Foreign Language Resource 
Center were positive and successful. Specific activities included conducting four summer 
institutes with 86 foreign language educators from across the nation, involving 20 teachers and 
researchers in a collaborative effort with the Center for Applied Linguistics in researching 
assessment practices and techniques in foreign language classrooms, continuing post-institute 
and post-workshop contact with participants through their collaborative projects, completing 
an extensive annotated bibliography of foreign language assessment instruments, and training 
and encouraging foreign language teachers to use e-mail as a viable, important, and effective 
communicrLon tool. The goals of trauiing teachers in the use of effective teaching strategies. 
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developmen: and interpretation of foreign language assessments, and the use of new 
teclinologies and their related objectives were met. 

These activities received consistently high ratings from participants. Foreign language 
teachers in grades kindergarten through twelve (K-12) and teacher educators directly 
benefited from the knowledge, skills, and resources provided through their experiences with 
the Center. These educators reported that they made approximately 110 presentations to over 
2800 other teachers and professional colleagues, school administrators, foreign language 
associations, parent groups, and student teachers in their school districts, at inservi-_e sessions, 
and at local, state, regional, and national conferences. Additionally, Center activities also 
indirectly affected many other K-12 foreign language teachers through numerous informal 
discussions with institute participants, newsletters, and resource sharing, suggesting that the 
impact of the Center is being felt among other K-12 teachers as well. 

Participants of all institutes gave positive evaluations. The effectiveness of the 
institute leaders had the highest average rating of all aspects surveyed on three of the four 
Institutes. Participants gave overall ratings to the institutes that were above average to 
excellent. They appreciated the opportunity to interact and share ideas with other 
participants who were interested in foreign language. In those institutes that focused on 
learning experiences, participants believed that they had improved their understanding of the 
content covered in the Institutes. Suggestions for improvement included lengthening the 
institutes or reallocating time during the institute to allow more time for interacting with other 
participants and exploring new ideas eind materials. Further, they suggested that receiving 
either a reading list or the reading materials for the institute, a detailed explanation or 
schedule of activities, and greater clarification of their post-institute commitment would 
enable them to better evaluate their abilities to 'ulfill the commitments and enhance their 
participation. 

The participants’ post-institute collaborative projects were not all as successful as 
hoped. While participants were enthusiastic about planning the projects and networking with 
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other teachers, the short time line for project completion dictated by the length of the grant 
fimding period and the teachers' lack of experience were barriers to successful implementation. 
Future institutes might consider alternatives to the small group project. One possibility is to 
encourage presentations as the primary follow-up activity, with consistent and thorough record 
keeping about the nature of the presentation, the number of attendees, and the audiences 
served. Such an alternative would be consistent with the institutes' ^oal of integrating and 
sharing knowledge about foreign language education with the profession. This emphasis would 
also capitalize on the enthusiasm generated at the institutes, as well as provide a practical 
way to encourage networking and dissemination. 

Overall, the National K-12 Foreign Language Resource Center has made great strides 
toward achievement of its goals. Adding the information gained from the evaluation to what 
was learned from the experience of operating the Center during this first funding period results 
in an expectation of further and potentially greater success in the future. 
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Appendix A 
Evaluation Plan 
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National K-1 2 Language Resource Center 
Evaluation Plan 



Evaluation of the activities of the National K-1 Z Language Resource Center is based on 
the goals and objectives of the Center and the impact of the activities on the target audiences. 
The focus of the evaluation is on assessing the degree to which the goals are accomplished. The 
goals and objectives, projects, and organizational structure have been designed to reflect the 
Center's overall purpose of contributing to the knowledge base, skills, and resources of foreign 
language teachers in grades kindergarten through twelve (K-1 2). The evaluation will consider 
the resources, techniques, procedures, and strategies employed to accomplish the goals and 
objectives. Assessments of the effectiveness and efficiency of the Center will provide 
information by which accurate judgrnents can be made about the strengths and weaknesses of 
operations and of program impact. 

The evaluation provides (1 ) input from the teachers and participants in the activities 
related to the Center's initiatives and (2) an assessment of the status of Center activities. 

Needs assessments, formative evaluation, and summative evaluation are components of the 
conceptual and operational evaluation framework. The evaluation plan utilizes both quantitative 
and qualitative methods to measure Center initiatives and participant attitudes and knowledge. 
The measures include documents, data from records, data from survey instruments, products 
(e.g., manuals, publications, videotapes, logs of e-mail use), and observations. While 
quantifiable measures are a significant component of the evaluatic.i plan, there are also plans 
for interviewing participants in the initial activities to allow them to express concerns and 
opinions through both formal and informal measures. 

The formative evaluation results will be of immediate use to those involved in 
administering the Center and carrying out its initiatives. The information collected through this 
internal evaluation will be included as a part of the summative evaluation activities that will be 
completed each funding period. 
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Needs Assessment for the Teacher Educator Partnership Institute 

Please use the following categories to indicate the level of previous experience you have had with the 
topics to be covered in this institute. Place a to the left of those topics you think should receive 
special emphasis during the institute. 

1. This will be basically new information, OR a thorough review would be welcome. 

2. I have some experience with the topic but do not feel entirely competent in the area. 

3. I have considerable experience with this topic and feel well informed. 

4. I could assist in presentation of this topic by providing information and examples. 



Topics to be covered in the institute 


New 

information 


Some 

experience 


Considerable 

experience 


Provide 

assistance 


History and rationale for elementary and school 
foreign language programs 










Program models 










Emphasis on FLES and Immersion 










Program planning 










Program evaluation 










Articulation 










Second language acquisition 










Child development 










Piaget 










Kieran Egan 










Information-processing perspectives 










Developing language skills for communication 










Listening 










Speaking 










Reading 










Writing 










Interactive writing: Dialogue journals 










Integrating with the elementary school 
curriculum /subject content instruction 










Teaching culture and global education 










Principles and processes for curriculum 
development 










Issues and strategies in assessment and grading 










Uses of technology for teachers and students 










Specific strategies for the classroom 










Activities and games 










Use of music and songs 










Rhymes and chants 










Using community resources 










Classroom organization 










Partner and small group work 










Learning centers 










Program publicity and public relations 










Working with parents and parent groups 










Working with administrators, classroom 
teachers, and other subject specialists 
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National K-12 Foreign Language Center 
Teacher Educator Partnership Institute 
Evaluation 



Your name ^ ^ ^ 

(This is for organizational purposes only. Your name will remain confidential.) 

To assess the impact of the institute, we are interested in comparing perceptions of 
your understanding of the topic areas before and after the institute. Please use the 
following categories to indicate the extent to which you understood the information 
covered in the institute before and after your participation. Place a check in the box 
that corresponds to your perception. (Imply the past tense of these categories when 
completing the "Before" portion of the form.) 

2 = No understanding 

2 = Understand basic concepts and techniques 

3= Understand basic concepts and techniques and feel comfortable experimenting 
with their application 

4= Am quite comfortable with applying the concepts and techniques presented 
5= Topic not covered in the institute ("After" portion only) 



Before 



1 


2 


3 


4 


Topics 


1 


2 


3 


4 


5 










History and rationale for elementary and school 
foreign language programs 




















Program models: Emphasis on FLES and Irmnersion 




















Prop-am planning 




















Program evaluation 




















Articulation 




















Second language acquisition 




















Child development theories (i.e., Piaget, Kieran 
Egan, information-processing perspectives) 




















DeV’ 'Oping language skills for communication 




















Listening 




















Speaking 




















Reading 




















Writing 




















Interactive writing: Dialogue journals 




















Integrating with the elementary school 
cuiTiculum/ subject content instruction 




















Teaching culture and global education 




















Principles and processes for curriculum development 




















Issues and strategies in assessment and grading 




















Uses of technologv for teachers and students 










. 



OVER 



o 
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1 = No understanding 

2 = Understand basic concepts and techniques 

3= Understand basic concepts and techniques and feel comfortable experimenting 
ivith their application 

4= Am quite comfortable with applying the concepts and techniques presented 
5= Topic not covered in the institute ("After" portion only) 



Before 



After 



1 


2 


3 


4 


Topics 


1 


2 


3 


4 


5 










Specific strategies for the classroom 












' 








Activities and games 




















Use of music and songs 




















Rhymes and chants 




















Using community resources 




















Classroom organization 




















Partner and small group work 




















Learning centers 




















Program publicity and public relations 




















Working with parents and parent groups 




















Working with administrators, classroom teachers, 
and other subject specialists 
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National K-12 Foreign Language Center 
Teacher Educator Partnership Institute 
Evaluation 

Please use the following 5 point scale to evaluate the Institute. Place a check in the 
box that corresponds to your rating. 

1 = Poor 2 = Below Average 3 = Average 4 = Above Average 5 = Excellent 





1 


2 


3 


4 


5 


1. 


Clarity of Institute objectives 












2. 


Organization of the Institute 












3. 


Effective use of time 












4. 


Applicability of information 












5. Electronic mail training 












6. 


Technology information 












7. 


Effectiveness of the Institute leader(s) 












8. 


Overall rating of the Institute 













Please indicate which aspects of the Institute were most useful to you and explain 
why. 




OVER 



June 27, l‘^94 



Please provide suggestions for improving the Institute. 



Other comments. 



■ J * 5 



Thank you for your feedback. 



National K-12 Foreign Language Center 
Curriculum Institute 
Evaluation 

We are interested in your opinions about the Curriculum Institute. Would you please 
answer the questions below and on the back of this page? Your responses are anonymous. 
Please complete the survey and return it to the person who distributed it to you. Thank you 
for your help! 

1 . What did you like best about the Institute? 



2 . What would have made the Institute more useful? 



OVER 

Ic'O 



August 10, 1994 



3 . 



What do you perceive as the major outcomes of the Institute? 



4 . What steps should the Center take with regard to foreign language curriculum? 




August 10, 1994 



National K-12 Foreign Language Center 
Curriculum Institute 
Evaluation 

Please use the following 5 point scale to evaluate the Institute. Place a check in the 
box that corresponds to your rating. 



I = Poor 2 = Below Average 3 = Average 4 = Above Average 5 = Excellent 



[T- 


2 


3 


4 


5 


1. 


Clarity of Institute objectives 












2. 


Organization of the Institute 












3. 


Effective use of the group process used in the Institute 












4. 


Effective use of time 












5. 


Applicability of information 












6. 


Applicability of the readings 












7. 


Usefulness of the curriculum resources provided 












8. 


Electronic mail training 












9. 


Effectiveness of the Institute leader(s) 












10. 


Overall rating of the Institute 













■y ^->1 # 



Aueust 10, 1994 



Needs Assessment for the New Technologies Institute 



Please use the foUowing categories to indicate the level of previous experience you have had with the topics to be 
covered in this institute. Place a * to the left of those topics you thiixk should receive special emphasis dunng the 



institute. 

1 . 

2 . 

3 . 

4 . 



This will be basically new information, OR a thorough review would be welcome. 

I have some experience with the topic but do not feel entirely competent in the area. 
I have considerable experience with this topic and feel well informed. 

I could assist in presentation of this topic by providing information and examples. 



Topics to Be Covered in the Institute j 


^ew S 

nfoniution 1 


iome C 

’xperience i 


'onsiderable 1 
'xperience ^ 


Provide 

\5sisUnce 


Computer Assisted Instruction 




















Knowledge and Use of Foreign Language Software 










. Selection of appropriate software 




















Satellite Programs 




















Distance Learning Courses 




















Multimedia Platforms 




















Telecommunications 










Local and wide area networks 










Hardware and. software 










How to send and receive e-mail 










Teleconferencing 










FTP 




















Commercial Wide Area Networks Available 










America online 










Internet access services 










Minitel 




















Internet Areas of Interest 










Gopher 










World Wide Web 










Bulletin boards 










Newsgroups 










Listservs 




















Educational Use of E-mail 




















Planning Telecommunications Lessons 




















Setting Up Sister Schools Networking Connections 






1 



O 
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june 1994 



Describe to what extent and how you currently use technology' in instruction in your classroom. 



Describe to what extent and how you use technology for personal use (e-mail, word processing, etc.) 



What are your main goals for learning in this workshop? 




ation.ll k-12 Foreign Language Center 
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National K-12 Foreign Language Center 
New Technologies Institute 
Evaluation 



Your name ^ ^ ^ 

(This is for orgarrizational purposes only. Your name will remain confidential.) 

To assess the impact of the institute, we are interested in comparing perceptions of 
your understanding of the topic areas before and after the institute. Please use the 
following categories to indicate the extent to which you understood the information 
covered in the institute before and after your participation. Place a check in the box 
that corresponds to your perception. (Imply the past tense of these categories when 
completing the "Before" portion of the form.) 

2 = No understanding 

2= Understand basic concepts and techniques 

3= Understand basic concepts and techniques and feel comfortable experimenting 
with their application 

4= Am quite comfortable with applying the concepts and techniques presented 
MA= Not applicable. This topic was not covered in the institute. 



1 


2 


3 


4 


topics 


1 


2 


3 


4 


NA 










Computer Assisted Instruction 




















Knowledge and Use of Foreign Language Software 




















Selection of appropriate software 




















Sc'tellite Programs 




















Distance Learning Courses 




















Multimedia Platforms 




















Telecommunications 




















Local anvi wide area networks 




















Hardware and software 




















How to send and receive e-mail 




















Telecoriferencing 




















FTP 




















Commercial Wide Area Networks Available 




















America online 




















Internet access services 




















Minitel 




















Internet Areas of Interest 




















Gopher 




















World Wide Web 




















Bulletin boards 




















Newsgroups 




















Listservs 




















Educational Use of E-mail 




















Planning Telecommunications Lessons 




















Setting Up Sister Schools Networking Connections 













1 or 



August 10, 1994 



National K-12 Foreign Language Center 
New Technologies Institute 
Evaluation 

Please use the following 5 point scale to evaluate the Institute. Place a check in the 
box that corresponds to your rating. 



1 = Poor 2 = Below Average 3 = Average 4 = Above Average 5 = Excellent 





1 


2 


3 


4 


5 


1. 


Clarity of Institute objectives 












2. 


Organization of the Institute 












3. 


Effective use of time 












4. 


Applicability of information 












5. 


Information on setting up sister schools networking 
connections 












6. 


Information on educational uses of Email 












7. 


Information on foreign language software 












8. 


Effectiveness of the Institute leader(s) 












9. 


Overall rating of the Institute 













Please indicate which aspects of the Institute were most useful to you and explain 
why. 



OVER 




August 10, 1994 



Please provide suggestions for improving the Institute. 



Other comments about the Institute. 



Thank you for your feedback. 






Auttusl 10, l‘^94 



Needs Assessment for the Interactive Multimedia Authoring Institute 



Please use the following categories to indicate the level of previous experience you have had with the topics to be 
covered in this institute. In the column "Program Names or Name /Brand," write in the appropriate names of 
software or hardware. Place a * to the left of those topics you think should receive special emphasis during the 

institute. 

1. This will be basically new information, OR a thorough review would be welcome. 

2. I have some experience with the topic but do not feel entirely competent in the area. 

3. I have considerable experience with this topic and feel well informed. 

4. I could assist in presentation of this topic by providing information and examples. 



Topics to Be Covered in the Institute 




New J 

Information 1 


Experience < 


^onsiderabl 1 
* Experience ^ 


Provide 

Assistance 


General Computer Software 


Program Names 










Working knowledge of: 












Macintosh word processing program 












Database /spreadsheet software program 












Graphics or paint program 












Telecommuiucation software and use of e- 
mail 












DOS/Windows (IBM compatibles) 
























Foreign Language Specific Software 


Program Names 










Knowledge and use of general foreign 
lan<iua<ie software: 












Drill and practice 












Tutorial 












Games 












Simulations 












Word processing 












Knowledge/use of multimedia foreign 
lanzuate prozrams: 












Videodisc (level 1 and 2) 












Videodisc with software 












CD-ROM programs 












Existing hypercard stacks 
























Computer-based Hardware Experience 


Name/ Brand: 










Working knowledge of IBM or compatible PC 












Knowledge/ use of modem 












Knowledge/ use of scanner equipment 












Knowledge /use of digital camera 
equipment 












Knowledge/ use of videodisc player 












Knowledge /use of CD-ROM/ photo-CD 
plaver 
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Topics to be Covered in the Institute (con’t) 




New 

Information 


Some 

Experience 


Considerabl 
e Experience 


Provide 

Assistance 


Multimedia Background 


Ehcogram Name 










Working knowledge of: 












HyperCard 












Other authoring tool program for 
multimedia production (e.g. Director 4.0) 












Quicktime or other video-editing program 
le 2 . VideoSvi^ot, VideoFusion) 












Sound production software 




1 








Describe to what extent you currently use technology in instruction. 



•» 



List several specific goals you hope to achieve during this workshop. 




O 
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National K-12 Foreign Language Center 
Interactive Multimedia Authoring Institute 
Evaluation 



Your name ^ — — — 

(This is for organizational purposes only. Your name will remain confidential.) 

To assess the impact of the institute, we are interested in comparing perceptions of 
your understanding of the topic areas before and after the institute. Please use the 
following categories to indicate the extent to which you understood the information 
covered in the institute before and after your participation. Place a check in the box 
that corresponds to your perception. (Imply the past tense of these categories when 
completing the "Before" portion of the form.) 

1= No understanding 

2= Understand basic concepts and techniques 
. 3= Understand basic concepts and techniques and feel comfortable experimenting 
with their application 

4= Am quite comfortable with applying the concepts and techniques presented 
NA= Not applicable. This topic was not covered in the institute. 



1 


2 


1C 

3 


4 


Topics 


1 


2 


3 


4 


NA 










General Computer Software 




















Macintosh word processing program 




















Database /spreadsheet software program 




















Graphics or paint program 










. . 










Telecommunication software and use of E-mail 




















DOS/Windows (IBM compatibles) 




















Foreign Language Specific Software 










— 










Drill and practice 




















Tutorial 




















Games 




















Simulations 




















Word processing 




















Foreign Langu^e Multimedia Programs 




















Videodisc (level 1 and 2) 




















Videodisc with software 




















CD-ROM programs 




















Existing hypercard stacks 




















Computer-based Hardware Experience 




















Knowled^e/use of modem 




















Knowledge/use of scanner equipment 




















Knowledge/use of digital camera equipment 




















Knowledge/ use of videodisc player 




















Knowledge/use of CD-ROM/ photo-CD player 




















Multimedia Background 




















HyperCard 




















Other authorine tools for multimedia production 




















Quicktime or otlter video-editing programs 


















Sound production software 













O 
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National K-12 Foreign Language Center 
Interactive Multimedia Authoring Institute 
Evaluation 

Please use the following 5 point scale to evaluate the Institute. Place a check in the 
box that corresponds to your rating. 



1 = Poor 2 = Below Average 3 = Average 4 = Above Average 5 - Excellent 





1 


2 


3 


4 


5 


1. 


Clarity of Institute objectives 












2. 


Organization of the Institute 












3. 


Effective use of time 












4. 


Applicability of information 












5. 


Electronic Mail Training 












6. 


Effectiveness of the Institute leader(s) 












7. 


Overall rating of the Institute 













Please indicate which aspects of the Institute were most useful to you and explain 
why. 



OVER 



August 17, 1994 



131 



Please provide suggestions for improving the Institute. 



Other comments about the Institute. 



Thank you for your feedback. 




August 17, 



Follow-up Surv ey of National K-12 Foreign 
Language Center Institute Participants 



We know you are busy, but we need your help in improving the activities of the National 
K.-12 Foreign Language Center! As you may know, the Research Institute for Studies in 
Education (RISE) is completing the evaluation of Center activities for this year. Earlier 
this month, we emailed this survey to you, but we haven't received your responses yet. 
Would you please access your email to complete the survey and email it back to 
moran@iastate.edu by May 29? 

If you need help replying to the email version of the survey, please call (515-294-7009) or 
fax (5 1 5-294-9284). If you prefer to respond by paper, please complete this paper version 
of the survey and mail in the enclosed pre-paid envelope or fax by May 29. 






********************************************* ******** 



Which institute did you attend? 

[] Teacher Educator Partnership 

[] Curriculum 

[] New Technologies in the Foreign Language Classroom 

[] Interactive Multimedia Authoring 

1 The amount of communication I have with staff at the Foreign Language Center is 
too little [] about right [] too much [] 



2. The amount of communication I have with Leader(s) of the Institute I attended is 
too little [] about right [] too much [] 



3 . 



The amount of communication I have with other participants is 
too little [] about right [] too much [] 



Indicate your level of agreement with the following statements (questions 4-13). Use *he 
scale below. 

6= strongly agree 
5= agree 

4= somewhat agree 
3= somewhat disagree 
2= disagree 
1= strongly disagree 

If you answer 1, 2, or 3 (some level of disagreement) for any of these questions, please 
use the final question of the survey to elaborate. 



My communication with Center 
staff was useful. 


12 3 4 5 6 
[] [] [] [] [] [] 


My communication with Institute 
Leader(s) was useful. 


1 2 3 4 5 6 
[] [] [] [] [] [] 


My communication with other 
participants was useful. 


12 3 4 5 6 
[] [] [] [] [] [] 


The Center has been a valuable 
source of materials and 
information throughout the 
school year. 


12 3 4 5 6 
[] [] [] [] [] [] 


Institute leader(s) have been 
supportive of my teaching efforts 
throughout the school year. 


12 3 4 5 6 
[] [] [] [] [] [] 


Center staff has been 
supportive of my project 
throughout the school year. 


12 3 4 5 6 
[] [] [] [] [] [] 


Institute leaders have been 
supportive of my project 
throughout the school year. 


12 3 4 5 6 
[] [] [] [] [] [] 



1 1 . The skills and information I 1 2 3 4 5 6 

gained from the institute have [] [] [] [] [] [] 

been useful to me professionally. 



12. My institute project has been 
useful to me professionally. 



1 2 3 4 5 6 
[] [] [] [] [] [] 



How have you changed your teaching as a result of this past year's experience vvith 
the National K-12 Foreign Language Center? Be specific. 



Many of you have given formal presentations, demonstrations, and workshops relating to 
the institute you attended. The following questions ask you to describe those activities. 

14a. How many presentations, demonstrations, and workshops have you given since the 
institute? 

1 4b . Approximately how many people attended‘s 

1 4c. Please describe the topics of your presentations. 





f ■ 

o 



14d. Describe the audiences and/or organizations presented to. 



1 5 How have you informally shared information gained from the institute with 
colleagues, administrators, students, and the community? 



16. Comments 



Thank you for taking the time to respond. If you have any questions or comments 
reuarding this survey, contact the Research Institute for Studies in Education. Your 
answers will help improve Center activities. 

RISE 

E005 Lagomarcino Hall 
Iowa State University 
Ames, Iowa 5001 1 
phone: 515-294-7009 
fax; 515-294-9284 
email' moran@iastate.edu 






Evaluation Report 

Executive Summary 
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Research Institute for Studies in Education 

E005 Dgunurcino Hah • Cohege oh Edi'Cation • Iowa State Univehsiti’ • Ames, Iowa 50011 



13 



National K-1 2 Foreign 
Language Resource Center 

Evaluation Report Executive Summary 







The National K-12 Foreign Linguagc Resource Center, one of 
six centers funded by the L'.S. Department of Education, was 
established at Iowa State University (ISLT), Ames. Iowa to 
support K-12 foreign language education nationally. 

Initiatives of the Center focus on professional development of 
elementarv and secondare' school foreign language teachers, 
with particular emphasis on activities related to the national 
standards for elementary and secondare' .school foreign 
language. These initiatiees and related actie'ities during the 
first 16 months included four summer institutes at Iowa State, 
a tevo-day evork.shop at the Center for Applied Linguistics 
(CAL) in 'Oi'a.shington, D.C.. and development of an annotated 
assessment bibliography. 



Center Initiatives 
and Key Activities 

Initiative I: Use of Effective Teaching Strategies 

Teacher Educator Partnership Institute 
Curriculum Institute 

Initiative U: Administration and Interpretation of 
Foreign Language Performance Assessment 

Assessment Guidelines and Strategies Workshop 
Annotated Assessment Bibliography Preparation 

Initiative III: Use of New Technologies 

New Technologies Institute 
Interactive Multimedia Authoring Institute 



Evaluation of the Center and its activities was conducted by 
the Research Institute for Studies in Education (RlSEl at ISU. 
The major findings of the evaluation are presented in this 
executive summary', (The complete report is available from 
the Center.) Descriptions of each of the institutes and the 
worksluip is followed b\' a description of follow-up projects, 
the as.sessment bibliography, on-going Center suppon, and a 
summarv'. 
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Teacher Educator 
Partnership Institute 

The Teacher Educator Partnership Institute w'as designed to 
provide a professional development opportunity in effective 
teaching strategics for foreign language teacher educators who 
sen'e as methods profes.sors at institutions of higher 
education. Special consideration was given to providing 
training and classroom experiences at the K-6 level because 
most teacher educators do not have direct experience at tho.se 
levels. Nine teacher educators and 13 elementary' school 
foreign language teachers attended the Teacher Educator 
Partnership Institute. The teacher practitioners had an 
average of 8 years of experience teaching Spanish, French. 
Japanese, and/or Latin in grades K-6. The teacher educators 
taught post-secondary' Spanish and/or Japanese, 

In generai, participants beiievcd tiiat tiicn had a better 
understai ng of all of tbe topics following the Institute, 
Evaluation ratings indicate that participants were positive 
about the Institute, citing opportunities to interact with 
In.stitute leaders and other participants as one of the most 
useful aspects of the Institute. .Many also mentioned the 
benefit of gaining a better perspective of current practice in 
foreign language education and tbe value of leaders modeling 
teaching methods discussed during the In.stitute. 

Curriculum Institute 

The purpose of the Curriculum Institute was to engage 
experienced and practicing foreign language educators in the 
critical analysis of traditional curricula for foreign languages 
and to develop new .strategies and frameworks for the 
emerging long .sequences of language .study. Participants were 
24 K-12 teachers, many of whom hold district level positions 
such as director or chair of the foreign language department. 
They had an average of 18 years of experience teaching 
Spanish, French, Chine.se. and/or Ru.ssian. 

.At the conclusion of the Institute, mo.st participants .stre.ssed 
the importance of disseminating the information that had 
been put together. .Many suggested .strategies for thi.s. such as 



publishing the materials and having the panicipants distribute 
the information in the states in their areas. Many also 
expressed their appreciation for the training and experience 
and their commitment to sharing their experiences with 
others. As one participant stated. "The opportunity to interact 
with educators from across the country ... has been exciting 
and motivating. We need more opportunities like this one to 
share, to learn, to network." Others commented on the 
quality of the Institute's facilitators, citing their knowledge, 
skill, organization, and flexibility. 



**The Institute gave nie the push 
needed to . . . become an avid 
computer user and advccate of 
use of technology in the 
classroom.*' . . thanks to the 
New Technologies Institute and 
the NFLRC ... I am so far one of 
the few teachers [in my district] 
with really practical training and 
some level of skill on the 
Internet.** ^As a result of the 
institute] my principal and the 
district technology coordinator 
. view me as a major contributor 
to integrating technology Into my 
.school's curriculum. They 
' 'rospect my wdrk^ use It as 
models for other curriculum 
areas, and isolicit advice and 
Ideas from me. I am co>chair of 
the Standarils Framework Writing 
Committee for foreign language 
in my state. This responsibility 
resulted from my project.** 
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New Technologies Institute 

The New Technologies Institute was designed to introduce 
panicipants to the benefits of using newly developed 
technologies in foreign language education. Participants 
examined recent developments in the application of new 
technologies, previewed exemplar}- foreign language 
courseware, implemented u.se of telecommunications 
networks, developed telenetworking lessons, and gained 
expertise in the use of electronic mail, forums, and bulletin 
boards, A total of 20 elemental-}- and secondary school 
teachers attended the New Technologies Institute. The 



participants taught French, Spanish. German, Japanese, and/or 
Romanian and had an average of 18 years of experience. 

Participants showed significant improvements in all topics 
covered by the New Technologies Institute. They reported 
that the most useful aspects of the Institute included learning 
to effectively use e-mail and the Internet, the hands-on format 
of instruction, the opportunity to meet and exchange ideas 
with other teachers, the textbook, and the exposure to 
varied softw-are. 

Interactive Multimedia 
Authoring Institute 

The Interactive .Multimedia Authoring Institute was designed 
to introduce participants to the benefits of using multimedia 
in foreign language education. Participants examined 
exemplar}- multimedia hardware and software, authored a 
HyperStudio stack, and prepared a HyperStudio lesson linked 
to CD ROM, videodisk, and/or motion video. The 20 
participants taught elementary and secondary school Spanish, 
French, German, Japanese, Russian, and/or Chinese. Their 
average K-12 teaching experience was 11 years. 

Participants showed significant improvements in all topics 
related to foreign language multimedia programs. They 
indicated that the most valuable aspects of the Institute 
included e-mail training, learning to use authoring softw-are, 
and the emphasis on hands-on activities. Participants 
appreciated the helpfulness of Institute staff and the 
opportunity to meet and exchange ideas with other foreign 
language teachers. 

Assessment Guidelines and 
Strategies Workshop 

The Assessment Guidelines and Strategies Workshop, co- 
sponsored by the Center for Applied Linguistics, was designed 
to find out from K-8 classroom foreign language teachers how 
they currently use assessment, how they view assessment, and 
what can be expected of teachers in the classroom related to 
assessment. Twelve teachers worked in collaboration with 
eight researchers to begin development of an assessment 
framework based on the American Council on the Teaching of 
Foreign Language’s (ACTFL) national K-12 standards. 

Participants felt that the most useful aspects of the workshop 
included sharing, discussing, interacting, and networking with 
other teachers and learning w-hat they are doing in their 
programs. Portfolios, rubrics, journals, report card formats, 
and self-a.sses.sments were mentioned frequently as 
a.sse.ssment strategies that re.spondents learned about and 
thought could be used in their own classrooms. 
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**l have had my students develop 
HyperStudio stacks in our new six- 
station multimedfa lab. We have 
recently had an e-mail exchange 
with a French class in Russia 
(facilitated by one of last 
summer’s participants) and are 
now exchanging messages with a 
class in Oregon.” 



Follow-up Projects 

Summer institute participants implemented ideas and 
strategies from the institutes by working together in small 
groups on follow-up projects. The projects gave panicipants a 
practical opponunity to implement what they had learned. 

The Center is making the re.sults of selected projects available 
to the profes.sion by publishing summanes in the Center 
newsletter, publishing complete repons through ERIC, 
submitting articles to profe.ssional journals, and developing a 
World Wide Web page on the Internet. 

Examples of projects include examining K-6 teacher 
certification and implementation of the national standards, 
preparation of thematic units, effective aniculation strategies 
■.loros'; levels of insmiction. use and application iT romniiter 
mediated communication in the foreign language classroom, 
exploration of the Internet for the novice. 

Annotated Assessment 
Bibliography Preparation 

In collaboration with CAL, center staff have prepared an 
annotated bibliography of assessment instruments. Published 
and made available through the ERIC system, the bibliography 
contains standardized in.struments and authentic tools .such as 
oral as.sessment inventories, language ponfolios, and student- 
teacher conferencing forms. In addition to each instrument, 
information on the target audience, appropriateness of the 
te.st. age level/grade level, and a point of contact were 
included. Selected bibliographies of recent anicles. books and 
documents on assessment, and commercially available tests 
were provided. .All tests were cross-referenced by skill area 
and purpo.se. 



On-going Center Support 

Overall, most of the respondents agreed that communication 
with Center .staff, in.stitute leaders, and other panicipants 
throughout the project period was useful and about the right 
amount. In addition, the majority agreed that the Center has 
been a valuable source of materials and information. 
Respondents also generally agreed that the skills and 
information gained from the institutes have been useful, and 
that their project has been useful. 

A key component of each project was the use of e-mail for 
communication between and among institute staff and 
teachers. .All of the panicipants attending each of the four 
summer institutes learned how to exchange e-mail, resulting 
in a substantial increase in the number of e-mail accounts and 
in the volume of e-mail communication. 

Summary 

The first 16 months of activities at the .National K-12 Foreign 
Language Resource Center were positive and successful. 
Specific activities included conducting four summer institutes 
with 86 foreign language educators from across the nation, 
involving 20 teachers and researchers in a collaborative effon 
with the Center for Applied Linguistics in researching 
assessment practices and techniques in foreign language 
classrooms, continuing post-institute and post-workshop 
contact with panicipants through their collaborative projects, 
cunipieting an e.\ieiisive aiiiiutated bibliography of foreign 
language assessment instruments, and training and 
encouraging foreign language teachers to use e-mail as a 
viable, important, and effective communication tool. The 
goals of training teachers in the use of effective teaching 
strategies, development and interpretation of foreign language 
a.ssessments, and the use of new technologies and their 
related objectives were met. 




' you for this opportunity. I min. 
learning so much that will be 
' Immediately applicable at home. 
It was so nice to be treated like a 
valuable, intelligent Individual. 
This was wonderfuir ... . 
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